Skip to content

Conversation

@varun-edachali-dbx
Copy link
Contributor

What type of PR is this?

  • Bug Fix

Description

Earlier, execute_command in SeaDatabricksClient was expecting a List[Dict[str, Any]], with the intention of implementing parameter processing later and converting them into a simple List[Dict] to be consumed by the SEA backend.

But, this does not align with the current code which passes a List[ttypes.TSparkParameter]. Also, re-using this Thrift parameter object allows us to re-use the existing parameter processing completely.

How is this tested?

  • Unit tests
  • E2E Tests
  • Manually - running related e2e tests after setting "use_sea": True in the connection params
  • N/A

Related Tickets & Documents

N/A

Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
@varun-edachali-dbx varun-edachali-dbx marked this pull request as draft June 26, 2025 10:08
@varun-edachali-dbx varun-edachali-dbx marked this pull request as draft June 26, 2025 10:08
@vikrantpuppala vikrantpuppala removed their request for review July 8, 2025 03:37
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
@varun-edachali-dbx varun-edachali-dbx changed the title SEA parameters fix: pass params as ttypes.TSparkParameter to re-use existing parameter processing SEA: support primitive params Jul 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants